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CLAIM LISTING 



A listing of an entire set of claims is submitted herewith per 37 CFR §1.121. This 
listing of claims will replace all prior versions, and listings, of claims in the application. 

1 . (Currently Amended) For us e in a system (100) capable of cr e ating visual 
summari e s of video mat e rial, an An apparatus (130, 200) for creating a compact visual 
summary of video material , said apparatus (130, 200) comprising: 

a visual summary controller (130, 200) capabl e of operable for: 

receiving keyframes of said video material; 
wherein said visual summary controll e r (130, 200) is capabl e of 

extracting frame signatures from said keyframes to establish a plurality of 
family histograms; 

, and capabl e of using said fram e signatur e s ordering said plurality of 
family histograms to create respective superhistograms each including multiple family 
histograms from said k e yfram e s , and capabl e of 

using said fram e signatur e s and said sup e rhistograms to s e l e ct 
selecting representative keyframe images for each superhistogram to 
create a compact visual summary of said video material, 

wherein said representative keyframe images for each superhistogram include at 
least one of (1) the first image in each family histogram, (2) th e most m e aningful imag e 
in- gaj4 each sup e rhistogram, (3) a randomly chosen image, and (4) an image that is 
closest to th e clust e r a center of each family histogram . 

2. (Currently Amended) The apparatus (130, 200) as claim e d in of Claim \ x wherein said 
visual summary controller (130, 200) is capabl e of operable for filtering said keyframes 
and extracting frame signatures from said filtered keyframes before using said frame 
signatures to create said superhistograms to create a compact visual summary of said 
video material. 

3. (Currently Amended) The apparatus (130, 200) as claim e d in of Claim 2 a wherein said 
visual summary controller ( (130, 200) is capabl e of operable for creating said compact 
visual summary of said video material by using said superhistograms to cluster said 



3 



Ser. No. 09/866,394 
Att. Docket: US010265 

filtered keyframes, and by adding a representative keyframe from said clustered 
keyframes to said compact visual summary of said video material. 

4. (Currently Amended) The apparatus (130, 200) as claim e d in of Claim 2 A wherein said 
frame signature is a histogram. 

5. (Currently Amended) The apparatus (130, 200) as claim ed-ja of Claim 3 a wherein the 
distance measure for clustering is equal to a histogram difference calculated by one of: 
LI distance measure method, L2 distance measure method, histogram intersection 
method, Chi Square test method, and bin-wise histogram intersection method. 

6. (Cancelled) 

7. (Currently Amended) The apparatus (130, 200) as claim e d in of Claim 5 a wherein said 
visual summary controller (130, 200) is capabl e of operable for selecting a family 
histogram to use to create said compact visual summary of said video material. 

8. (Currently Amended) The apparatus (130, 200) as claim e d in of Claim 1^ wherein said 
visual summary controller (130, 200) further comprises[[:]] a visual summary retrieval 
module (1 8 0) capabl e of operable for retrieving a compact visual summary stored in a 
memory unit (120) and causing said compact visual summary to be displayed in response 
to a user request. 

9. (Currently Amended) The apparatus (130, 200) as claim e d in of Claim 1 A wherein said 
visual summary controller (130, 200) is capabl e of operable for using said compact visual 
summary to access at least one portion of said video material. 

10. (Currently Amended) The apparatus (130, 200) as claim e d in of Claim S^wherein 
said visual summary controller (130, 200) is capabl e of operable for using said compact 
visual summary to create new video material. 

1 1 . (Currently amended) A system (100) capabl e of cr e ating operative to create visual 
summaries of video material, said system (100) comprising an apparatus (130, 200) for 
creating a compact visual summary of video material, said apparatus (130, 200) 
comprising: 

a visual summary controller (130, 200) capabl e of operable for: 
receiving keyframes of said video material[[;]] A 
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wher e in said visual summary controll e r (130, 200) is capabl e of 

extracting frame signatures from said keyframes to provide a plurality of 

family histograms, and capabl e of using 

ordering said plurality of family histograms fram e signatur e s to create 

respective superhistograms . each superhistogram including multiple families of 

histograms from said keyfram e s , and capabl e of using said fram e signatur e s and said 

sup e rhistograms to s e l e ct 

selecting representative keyframe images for each superhistogram to 

create a compact visual summary of said video material, 

wherein said representative images for each superhistogram include at least one of 

(i) the first image in each family histogram, (2) th e most m e aningful imag e in e ach 

superhistogram, (3) a randomly chosen image, and (4) an image that is closest to-the 

clust e r a center of each family histogram . 

12. (Currently Amended) The system (100) as claim e d in of Claim 1 1^ wherein said visual 
summary controller (130, 200) is capabl e of filtering operative to filter said keyframes 
and extracting extract frame signatures from said filtered keyframes before using said 
frame signatures to create said superhistograms to create a compact visual summary of 
said video material. 

13. (Currently Amended) The system (100) as claim e d in of Claim 12 a wherein said 
visual summary controller (130, 200) is capabl e of cr e ating operative to create said 
compact visual summary of said video material by using said superhistograms to cluster 
said filtered keyframes, and by adding a representative keyframe from said clustered 
keyframes to said compact visual summary of said video material. 

14. (Currently Amended) The system (100) as claim e d in of Claim 12^ wherein said 
frame signature is a histogram. 

15. (Currently Amended) The system (100) as claim e d in of Claim 13 a wherein the 
distance measure for clustering is equal to a histogram difference calculated by one of: 
LI distance measure method, L2 distance measure method, histogram intersection 
method, Chi Square test method, and bin-wise histogram intersection method. 

16. (Cancelled) 
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17. (Currently Amended) The system (100) as claim e d in of Claim 44-13, wherein said 
visual summary controller (130, 200) is capabl e of s e l e cting operative to select a family 
histogram to use to create said compact visual summary of said video material. 

18. (Currently Amended) The system (100) as claim e d in of Claim 11* wherein said 
visual summary controller (130, 200) further comprises: 

a visual summary retrieval module (1 8 0) capabl e of r e tri e ving operative to retrieve a 
compact visual summary stored in a memory unit (120) and causing cause said compact 
visual summary to be displayed in response to a user request. 

19. (Currently Amended) The system (100) as claim e d in of Claim 13* wherein said 
visual summary controller (130, 200) is capabl e of using operative to use said compact 
visual summary to access at least one portion of said video material. 

20. (Currently Amended) The system (100) as claim e d in of Claim 13* wherein said 
visual summary controller (130, 200) is capable of using operative to use said compact 
visual summary to create new video material. 

21. (Currently Amended) For us e in a syst e m (100) capabl e of opgrobl e for cr e ating 
visual summaries of vid e o mat e rial, a A method for creating a compact visual summary 
of video material , said m e thod comprising the steps of: 

receiving in a visual summary controller (130, 200) keyframes of said video 
material; 

extracting frame signatures from said keyframes to establish a plurality of family 
histograms; 

ordering said plurality of family histograms to create respective superhistograms 
each including multiple family histograms using said fram e signatur e s to cr e at e 
sup e rhistograms from said k e yfram e s ; and 

using said frame signatures and said superhistograms to select representative 
keyframe images for each superhistogram to create a compact visual summary of said 
video material , 

wherein said representative images of each superhistogram include at least one of 
(i) the first image in each family histogram, (2) th e most meaningful imag e in e ach 
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suporhistogram, (3) a randomly chosen image, and (4) an image that is closest to fee 
ekreter a center of each family of histograms . 

22. (Currently Amended) The method as claimed in Claim 21 further comprising the 
steps of: 

filtering said keyframes received in said visual summary controller (130, 200) ; 

and 

extracting frame signatures from said filtered keyframes before using said frame 
signatures to create said superhistograms to create a compact visual summary of said 
video material. 

23. (Original) The method as claimed in Claim 22 further comprising the steps of: 

using said histograms to cluster said filtered keyframes; and 
adding a representative keyframe from said clustered keyframes to said compact 
visual summary of said video material. 

24. (Currently Amended) The method as claimed in of Claim 23 a wherein the distance 
measure for clustering is equal to a histogram difference calculated by one of: LI 
distance measure method, L2 distance measure method, histogram intersection method, 
Chi Square test method, and bin-wise histogram intersection method. 

25. (Cancelled) 

26. (Currently Amended) The method as claim e d in of Claim 23 further comprising fee 
st e p of : selecting a family histogram to use to create said compact visual summary of 
said video material. 

27. (Currently Amended) The method as claim e d in of Claim 23 further comprising fee 
st e p s of : 

retrieving a compact visual summary stored in a memory unit (120); and 
causing said compact visual summary to be displayed in response to a user 
request. 

28. (Currently Amended) The method as claim e d in of Claim 23 further comprising fee 
st e p of [[:]] causing said visual summary controller (130, 200) to use said compact visual 
summary to access at least one portion of said video material. 
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29. (Currently Amended) The method as claimed in of Claim 23 further comprising fee 
s t e p of [[:]] causing said visual summary controller (130, 200) to use said compact visual 
summary to create new video material. 

30. (Currently amended) For use in a system (100) capabl e of operable for creating visual 
summaries of video material, computer-executable instructions stored on a computer- 
readable storage medium (125) for creating a compact visual summary of video material, 
the computer-executable instructions comprising the steps of: 

receiving in a visual summary controller (130, 200) keyframes of said video 
material; 

extracting frame signatures from said keyframes to provide a plurality of family 
histograms ; 

using said frame signatures to create superhistograms each having multiple 
families of histograms from said k e yfram e s ; and 

using said frame signatures and said superhistograms to select representative 
keyframe images for each superhistogram to create a compact visual summary of said 
video material, 

wherein said representative images of each superhistogram include at least one of 
(i) the first image in each family histogram, (2) th e most m e aningful imag e in e ach 
sup e rhistogram, (3) a randomly chosen image, and (4) an image that is closest to fee 
ehtster a center of each family of histograms . 

31. (Currently Amended) The computer-executable instructions stored on a computer- 
readable storage medium (125) as claim e d in of Claim 30 further comprising th e st e p of : 

filtering said keyframes received in said visual summary controller (130, 200); 

and 

extracting frame signatures from said filtered keyframes before using said frame 
signatures to create said superhistograms to create a compact visual summary of said 
video material. 

32. (Currently Amended) The computer-executable instructions stored on a computer- 
readable storage medium (125) as claim e d in of Claim 3 1 further comprising the st e ps of : 

using said histograms to cluster said filtered keyframes; and 
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adding a representative keyframe from said clustered keyframes to said compact 
visual summary of said video material. 

33. (Currently Amended) The computer-executable instructions stored on a computer- 
readable storage medium (125) as claim e d in of Claim 32^ wherein the distance measure 
for clustering is equal to a histogram difference calculated by one of: LI distance 
measure method, L2 distance measure method, histogram intersection method, Chi 
Square test method, and bin-wise histogram intersection method. 

34. (Cancelled) 

35. (Currently Amended) The computer-executable instructions stored on a computer- 
readable storage medium (125) as claimed in of Claim 34 30 further comprising th e st e p 
e£ selecting a family histogram to use to create said compact visual summary of said 
video material. 

36. (Currently Amended) The computer-executable instructions stored on a computer- 
readable storage medium (125) as claim e d in of Claim 30 further comprising th e st e ps of: 

retrieving a compact visual summary stored in a memory unit (125) ; and 
causing said compact visual summary to be displayed in response to a user 
request. 

37. (Currently Amended) The computer-executable instructions stored on a computer- 
readable storage medium (125) as claim e d in of Claim 32 further comprising the step of: 
causing said visual summary controller (130, 200) to use said compact visual summary to 
access at least one portion of said video material. 

38. (Currently Amended) The computer-executable instructions stored on a computer- 
readable storage medium (125) as claim e d in of Claim 32 further comprising the step of: 
causing said visual summary controller (130, 200) to use said compact visual summary to 
create new video material 

39. (New) The apparatus of Claim 1, wherein said representative frame further includes 
at least one of the most meaningful image in each superhistogram selected from the group 
consisting of a person's face and important text and a combination thereof. 
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40. (New) The system of Claim 11, wherein said representative frame further includes at 
least one of the most meaningful image in each superhistogram selected from the group 
consisting of a person's face and important text and a combination thereof. 

4 1 . (new) The method of Claim 2 1 , wherein said representative frame further includes 
at least one of the most meaningful image in each superhistogram selected from the group 
consisting of a person's face and important text and a combination thereof. 

42. (new) The computer executable instructions Claim 30, wherein said representative 
frame further includes at least one of the most meaningful image in each superhistogram 
selected from the group consisting of a person's face and important text and a 
combination thereof. 
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